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© Digital data message transmission networks and the establishing of communication paths therein. 

© A digital data message transmission network of interconnected network elements (12.14.16.18.20- 
32.34.36.40.44). maintains topology data bases (112) recording the potentially available communication routes 
through the network and the status of the network elements thereof, each node originating a message 
interrogating base to ascertain a suitable route: when connected into a route, whether completed or not 
recording the adjacent elements; when detecting the failure of any next adjacent link or node sending a ROUTE 
FAILURE MESSAGE to the route end(s) available to it to update the topology data base(s) for such route(s) 
whereby the route maintenance message traffic within the network is limited while ensuring that the topology 
data base associated with the origin of a route that does not establish and the topology data base or bases 
associated with both ends of all failed established route incorporating that failed element are correspondingly 
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DIGITAL DATA MESSAGE TRANSMISSION NETWORKS AND THE ESTABLISHING OF COMMUNICATION 

PATHS THEREIN 



The present Invention relates to digital data message networks and the establishing of communication 
paths th rein in which the communication path, or route, that a message takes through the network is 
computed dynamically, that is, the path is determined anew each time a communication session between 
two users of the network' is attempted to be established. 

s Communication networks are arrangements of computers, communication controllers and associated 
peripheral equipment and links which allow "end users" located at remote locations in the network to 
establish and maintain communication of information. An end user in this context may be a human user at 
some type of terminal, or an application program running on a host computer or on some type of intelligent 
device controller (ie, workstation, personal computer, display controller, etc). Figure 1 illustrates a small 

70 communication network 10. In it, two IBM System 370 host computers 12, 14 and three IBM 3725 
Communications Controllers 16. 18, 20 are interconnected, supporting five terminals 22. 24, 26, 28, 30 
connected as shown. Communication links 32, 34, 46, 38, 40, 44, interconnect the computers 12, 14 and 
controllers 16, 18, 20 as shown. 

Communication between, say. terminal 30 and host computer 12 in Figure 1 would be possible over 

75 several different paths. In order to visualise the communication in a network, a convention has been adopted 
in which the computers and communication controllers in a network are referred to collectively as nodes 
and the connections between nodes as links. End-user devices, whether displays, printers, etc are referred 
to collectively as terminals. Figure 2 depicts a node and link diagram of the network 10 shown in Figure 1, 
with like elements in Figure 2 having the same reference numerals as in Figure 1, but primed. Terminals 

20 are not shown in the diagram, since they are not directly involved in the communication establishment and 
control process to which the present invention is related. 

A conversation, called a session, between an end user at terminal 30 and an application program in 
host computer 12 in Figure 1 would involve communication between nodes 12 and 18. or 12' and 18' in 
Figure 2. Several different paths are possible for such a session. For example, communication could be 

25 simply via link 34', or the path could involve links 32' and 40' and node 16'. Alternatively, the path could 
involve links 32', 36' and 38' and nodes 16' and 14'. The choices increase with the size and complexity of 
the network. 

Except in very limited circumstances in which the network is fully connected, the information input at an 
origin node (supporting one end user) travels through one or more intermediate nodes before reaching the 

30 destination node (supporting the other end user). Information transmitted by one node and directed to 
another node must travel over the links interconnecting the nodes. In some networks, all information 
transmitted between two end users during a specific communication session traverses the same path, 
called in that case a route. The mechanism used to create the route, hereafter called the route mechanism, 
is dependent on a specific network architecture. 

35 Most network routing mechanisms use routing tables in each node (origin, intermediate, and destina- 
tion) to forward messages to the next node. Routing mechanisms may vary but several use an index into a 
routing table (the index being either a route identifier or a combination of source and/or destination node 
identifiers) to specify to which outbound link, and therefore to which next adjacent network node, the 
message is to be sent Naturally when the message reaches the destination node, but is instead processed 

40 by the end user. 

The routing tables in each network node can be established either statically or dynamically. In the static 
case, the routing definitions are fixed when network operating is started. The static mechanism is not 
relevant to the invention and will therefore not be discussed. 

In dynamic routing, a route creation technique is employed that dynamically creates an end-to-end 
45 route, from a source node to a destination node, which can be used during a specific communication 
session. This end-to-end route remains defined and active until all sessions using the route terminate. Then 
the route can be eliminated to free network resources, such as routing table entries to be used for other 
dynamically created routes. 

Several methods can be used to create dynamic routes within netw rks. One such method employs a 
so topology data base which contains the identity of all physical nodes and links in the network, including their 
connectivity, status, and physical characteristics to build a route dynamically. This method s lects 
appropriate nodes and links based on their recorded status and creates a message, hereafter called a 
ROUTE-SETUP message, containing a list of the nodes and links to be used in the route. The ROUTE- 
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SETUP message traverses ach node in the list, allowing each node to build an ntry in its routing tabl so 
that subsequent messages for a session assigned to the route can traverse th same physical nodes 
identified in the ROUTE-SETUP m ssage. Both forward and backward pointers are placed in the node 
routing table. 

5 Routing in communication networks is discussed by Jaffe et al in "SNA Routing: Past, Present, and 
Possible Future" appearing in the IBM Systems Journal. Vol. 22, No 4 (1983), Tymes in "Routing and Flow 
Control in TYMNET" appearing In the IEEE Transactions gn Communications. Vol. COM-29. No 4. (1981), 
and by McQuillan et al in "The New Routing Algorithm for the ARPANET" appearing in the IEEE 
Transactions on Communication^ Vol. COM-28. No S, (1980). 
io Clearly, it is important for the topology data base to have current information as to which nodes and 
links are available for communication. Otherwise, attempts might be made to create routes which have 
unavailable nodes or links, and several route creation attempts might be necessary before an available route 
is actually found. This represents an unnecessary waste of network resources. Other than by manual, 
operator input the reporting of the initial status, failures and reactivations of the network nodes and links. 
15 hereafter called network elements, has been done by the broadcast bf status changes by adjacent nodes. 
The Tymes and McQuillan et al articles mentioned above describe such broadcast update methods. These 
broadcast status updates have the advantage of not requiring operator intervention. However, they have the 
problem, especially in large and complex networks, of considerably increasing network overhead traffic. In 
some situations, it is preferable to accept less than perfect knowledge of the network status in order to 
20 reduce this overhead. In fact, rt is necessary in such networks to have some mechanism to "kill" the 
broadcast message which propagates throughout the system, or else the message reverberates throughout 
the network forever. Typical mechanisms include the incorporation of a cutoff time, after which the message 
is discarded from the network. However, even with such limiting mechanisms, status update messages 
occupy a large proportion of the overall network message-handling capability, such that there is less 
25 capacity available for users messages. 

Thus, it is apparent that there is a need for a means for updating a topology data base in a dynamic 
routing environment such that there are significantly reduced demands on the message handling capability 
of the network as compared with prior art schemes for updating topology data bases. 

Accordingly, the present invention provide a digital data message transmission network of intercon- 
nected message transmitting/teceiving nodes and communication links, collectively "network elements", at 
least one node being adapted, in operation, to maintain a topology data base recording the potentially 
available communication routes through the network and the status of the network elements thereof, each 
node being adapted to> 

when requiring to originate the transriiission of a message through the network, interrogate or have 
interrogated the topology data base to ascertain a suitable route; 

when connected into a route, whether or not that route is eventually completed, record for itself, the next 
preceding and succeeding network elements of and for that route; 

when detecting the failure of any next adjacent link or node, either in the attempted establishing of a route 
or in the use of an already established route, to originate a ROUTE FAILURE MESSAGE identifying the 
failed network element and transmit such message on the recorded network element for that route directed 
away from the failure; 

when receiving a ROUTE FAILURE MESSAGE, to retransmit the same along the route in the same 
direction, if internal to that route, or to the topology data base, if terminal to that route, or to update the 
topology data base for that route, if maintaining the topology data base, in respect of the status thereof; 
whereby the route maintenance message traffic within the network is limited while ensuring that the 
topology data base associated with the origin of a route that does not establish and the topology data base 
or bases associated with both ends of all failed established route incorporating that failed element are 
correspondingly updated. 

Such an arrangement greatly reduces the overall status message traffic in even a complex communica- 
tion network by ensuring that only the specific nodes involved in the use of an element are informed of the 
current status of that element 

The present invention will be described further by way of example with reference to preferred 
embodiments of the invention, as illustrated in the accompanying drawings, in which: 
FIG. 1 is a block diagram of a simpl mesh type communication network; 
FIG. 2 is a schematic representation of the network shown in FIG. 1; 
^ FIG. 3 is a schematic representation of a topology data base route table used by the network of Rg. 

FIG. 4 is a schematic representati n of a route statement; 
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FIG. 5 is a schematic representation of a ROUTE REQUEST messag ; 
FIG. 7 is a schematic representation of a ROUTE-SETUP message; 
FIG. 8 is a schematic representation of a routing table; 
FIG. 9 is a schematic representation of a ROUTE FAILURE message; and 
s FIG. 10 is a schematic representation of a network with a topology data base. 

In the drawings, like elements are designated with similar referenc numbers, and Identical elements in 
different specific embodiments are designated by identical reference numbers. 

The present invention incorporates a method and apparatus which can be used to dynamically report 
the status of the network nodes and links to topology data bases so that ROUTE-SETUP messages can be 
to created efficiently with knowledge of the physical route element status. The description that follows is 
applicable to an IBM SNA network comprising, for example, IBM System 370 computers and IBM 3725 
Communication Controllers as nodes, and suitable communication links for network interconnection. How- 
ever, the principles and protocols are presented with sufficient generality to enable application to any 
communication network having dynamic routing that relies on one or more topology data bases for route 
creation, and local routing tables at each node for the establishment and maintenance of communication 
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In the preferred embodiment, each topology data base is initially set up with information as to all of the 
nodes and links, and their potential connectivity to adjacent nodes. This information is entered by way of 
conventional input statements either interactively or via batch definitions. The link and node statements 

20 further specify certain characteristics, such as line(link) transmission speed, node buffer size, and element 
data transmission security, which are used by end users to request a route. These characteristics are set 
forth below under RULES OF OPERATION. DEFINITIONS & STATES, part a) Data Types. Additionally 
each network element in the topology data base is initially marked as 'assumed operative-, or available! 
This initial status has nothing to do with the actual status of the corresponding elements, but allows the 

as route selection technique to select the element for a route setup attempt and dynamically ascertain its 
actual operative or inoperative status via the feedback mechanism. The information is stored conventionally, 
in such a way as to be available for scanning and comparing when a route request is received. 

This information is entered for 1) routes. 2) links, and 3) nodes. Thus, assuming the interactive input 
method (as opposed to batch), a route statement is used to enter information defining a route between two 

so nodes between which communication is to be allowed. This statement specifies the links and nodes in 
order, in that route, and an identifier (ID) for that route. For each pair of nodes that may communicate ' as 
many route statements as there are distinct routes between those nodes may be entered Figure 3 
illustrates the topology data base entries for the potential routes between nodes 16' and 14' in Figure 2. In 
this case there are three such routes: 50. 52. and 54. Figure 4 illustrates the form of a route statement 58 

35 Link and node names 60 are placed in the sequence in which a message traverses that route, starting with 
the ongin node and ending with the destination node. The statement type 62 identifies the statement as a 
route statement 

Figure 5 illustrates a link statement 64 and a node statement 66. showing the various fields 68 70 
identifying the element and containing data for the aforementioned characteristics. The statement type 72 
74 identifies the statements as link or node statements, respectively. The information entered via the route' 
link and node statements is conventionally stored In such a way as to be available for scanning and 
companng when a route request is received, so as to. first, retrieve all routes identified between the 
specified end nodes, and. second, find the best match of characteristics for the elements in the selected 
routes against the specified characteristics and thereby select the best route. 

When an end user desires to communicate with another end user, a session is requested of the control 
program resident in the origin node. The session request includes the names of the source and destination 
nodes supporting the end users and a class of service. The class of service is a conventional shorthand for 
a set of the aforementioned characteristics of the route to be selected. In the preferred embodiment the 
information in the session request is forwarded in a message, hereafter called a ROUTE REQUEST 
Sr?rS e ;? rtl t 5^ eareSl aVaMab ' 8 top0l09y date ^ ^ the selection of a route. Figure 6 illustrates a 
SmL-t message 76. H comprises a request code 78. identifying the message as a ROUTE 

REQUEST, the ongin node name 79. the destination node name 80. and the class of service name 82 

Upon receipt of the ROUTE REQUEST message, the topology data base selects a potential" route 
whose elements conform to the characteristics identified in the specified class of service, ff a rout with the 
bb same exact set of elements is already in use with the same characteristics, ft session will be assigned to 

JlT^ V J!! at8d r0UtB - " 8 route ha » not alread y created - *• toP^ogy data bas is scanned to 
seiectthe best route between the source and destination nodes, based on the match of actual element 
characteristics against th characteristics requested. Only nodes and links which are assumed or known to 
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be operative can be selected in this process. The selected route is th n described in a m ssag containing 
a list of nodes and links comprising the route, along with a unique route identifier (route ID) for that route, 
hereafter called a ROUTE-SETUP message. Figure 7 illustrates a ROUTE-SETUP message 84. The request 
code 86 identifies th message as a ROUTE-SETUP message. The route ID 87 identifies the route. The 

5 node names and link names 88 appear in the sequence a messag travels on the route, as in the route 
statement 58 (Figure 4, supra). 

Route laments are assumed initially to be operative, because when the topology data base is 
activated, the status of each network element is unknown. Rather than initially obtaining the status of each 
element defined in the topology data base through operator input, exchanges with other data bases or 

to quenes of each network element, the status is learned as sessions are requested by using the preferred 
embodiment of the present invention herein described. 

As the ROUTE-SETUP message traverses the network, each active node creates routing table entries in 
conventional fashion for both directions of the communication. That is. when the ROUTE-SETUP message 
is processed, an entry is made in the routing table, containing the route ID (including origin and destination 

is node names or addresses) and the outbound link address. As is known, this permits quick routing of 
messages thereafter via the route ID accompanying the message. When a message arrives with this 
information, a simple table scan yields the outbound link address, which is sufficient for send.no the 
message on its way. 

In an alternative embodiment, the route ID is reduced to a single Local Path Identifier" (LPID) in each 
» node, which may be a sequentially selected number starting with zero that is assigned to a route as the 
ROUTE-SETUP message for that route arrives. The LPID is entered into the table, and sent back to the 
previous node for entry into that node's routing table. Each routing table, in this embodiment, has the LPID 
it assigns, the outbound link to the next node, and the LPID assigned by the next node in the route When a 
message arrives at a node in this embodiment the LPID for that node is extracted from the header and 
25 used to locate the table entry for that session. The next node's LPID. located in the table, is then 
exchanged for the incoming LPID. The message is then sent on to the next node via the assigned outbound 
link and so forth Rgure 8 illustrates a routing table 90 including a unidirectional entry 88 for a hypothetical 
oute using the LPID method. As shown, there are three elements to an entry, an LPID 94. tJortbound 
link ID 96. and the LPID for the next node 98. » » . uw guwouna 

so After the information necessary for the routing table entry is extracted from the ROUTE-SETUP 

"TT-* li 8em 00 t0 th6 ™* ° lem9nt " d 80 on ' t0 create 8,1 of «* necessary table entries for the 
route. If all nodes and links in the end-tr>end route are active, the ROUTE-SETUP will be successful and an 
end-to-end route will be created. 8,1 

„ B ni !fp h eSrn2 9 "** MC " "°* ^ fe m8rked « o*"" 3 ^- « * «*• cannot forward the 
» ROUTE-SETUP message to the next node because either the link to that node or the node itself is 
■noperative. men a ROUTE FAILURE message identifying the inoperative link or node is generated 
returned to the route origin for forwarding to the topology data base. The inoperative status is marked in the 
topology data base and that network element is not used in subsequent ROUTE-SETUP messages until its 
status changes. 

v As the ROUTE FAILURE message returns through each node identified in the ROUTE-SETUP each 
nodes routing table entry remains intact, with the status of the route being marked as inoperative. These 
tebte entnes are used for the feedback mechanism to the end node (and its topology data base) when the 

!^ ment rB " 8 ? V8te i ^ R0UTE FA ' LURE meSS88e is """WW ^ following the node routing 
table entnes set up from the failed ROUTE-SETUP message. Figure 9 illustrates a ROUTE FAILURE^ 

ROuTfa!^ 80 LP,D " b T d h inC ' Ude5 a R8quest <*»• 102 «■""*»■ •» message iTa 

Itoiro m meSS89e ' ,D oMh * detectin9 *° fai,ure 104 ' Fail8d * ement ,D «« 

When the node that reported the ROUTE FAILURE (the "adjacent node" detects that the inoperative 
element subsequently has become operative, a ROUTE ELEMENT OPERATIVE message is created and 
» sent to the ongin node for forwarding to its topology data base. The topology data base then resets that 

tX^S^lmSSSt^ J*, available for subsequent ROUTE-SETUP attempts" 

The ROUTE ELEMENT OPERATIVE message is identical to a ROUTE FAILURE message (100 Fio fl> 
except that the Request Code identifies it as a ROUTE ELEMENT OPERATIVE message ' 

If more than one route had attempted to use the inoperativ element, more than one set of routing table 
: entnes would have been created in the adjacent node and for as many of thos sets of entries a?Z been 
createdJtOUTE ELEMENT OPERATIVE m ssages would be seated" and sent^k to Te S 
origin nodes for resetting of their topology data base entries for that element to operative 9 
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This notification flows to the route origin node by following the node routing table entries set up from 
the failed ROUTE-SETUP message, in the same manner as the ROUTE FAILURE message. 

The same process is used after an end-to-end route is successfully established and a failure occurs on 
a link or node in the route. The same ROUTE FAILURE message is returned, in this case to both end 
nodes, th origin and the destination node, for forwarding to the topology data base of each end node. The 
ROUTE FAILURE message identifies the failing elem nl and as in the initial case of failure to set up the 
route, the routing table entries in th route s gments to the end nodes remain intact as the message travels 
back to the end node. As in the previous case, when the failed element becomes operative, the node 
routing table entries are used by ROUTE ELEMENT OPERATIVE messages (one in each direction around 
the point of failure) to follow the route back to the end node for forwarding to the topology data base(s) to 
indicate the operative status of the network element 

In either case, as the ROUTE ELEMENT OPERATIVE messages flow to the topology data base(s). the 
routing table entries are removed from the nodes along the route to recover the routing- table space just as 
if the end-to-end route were being normally deleted after the termination of all sessions using the route. 

The feedback mechanism functions in the face of both single point and multiple point failures along the 
route, as described in greater detail below. 

The basic elements of the feedback mechanism of the preferred embodiment can be described by a 
set of rules, definitions, states and protocols which may be applied to any communication network having 
dynamic routing of the type herein described. The protocols are described in four operational cases. 



RULES OF OPERATION. DEFINITIONS & STATES 
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1. TodoIoov Data Base. There will exist one or more topology data bases which contain network 
node, connectivity and status data which can be used to select and end-to-end route through a communica- 
tion network. 

For each route element (that is, for each network node, which can be either source, destination, or 
intermediate node host or communication processor; and for each link, which can be either teleprocessing 
link, channel connection, local teleprocessing loop, Local Area Network, fibre optic line, or any other 
medium which can connect two host or communication processor nodes), there exists a set of parameters 
as follows: 
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Element 
Node 



Identifiers 
Node Name 
Node Address 



Connectivity 
Adjacent 
nodes 



Characteri sties Status 

Message Storage Operative 

Capacity Inoperative 

Processing Power Unknown/ 



Security 



(Assumed 
Operative) 
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Link Link Name Adjacent 

Link Address nodes 



Bandwidth 

Reliability 

Security 



Operative 
Inoperative 
Unknown/ 
(Assumed 
Operative) 
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These characteristics are well known in the art 

Various methods can be utilised to creat th entries and elem nt knowledge in the topology data base. 
They include operator input, a system generation process, automatic element identification at el ment 
activation, etc. 
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2. Rojjig $eleflu?n Algorithm. The algorithm(s) utilised to select a route (ie. secure least delay 
greatest bandwidth, etc) should not affect the operability of the invention in a network, provided the' 
selection algorithm adheres to the nil s for creation of the selected route list and element status described 
above. 

3. Qsm BaOilSSl Mechanjsm. A mechanism is provided to allow a user to request an end-to-end 
route from source to d sanation nodes through th network. This requ st is sent to a topology data base 
with an indication as to the characteristics (secure, least delay, etc) desired. The request initiates the route 
selection process in the topology data base and creates a ROUTE-SETUP message. 

4. ROgTE-SETUP Message . This is a message which contains the list of nodes and links selected 
to create the end-to-end route from source to destination nodes. The ROUTE-SETUP message traverses 

tfJS^JT * e S ° UrCG t0 ** deStination ' nodo to ,ink to node to link. etc. in the order specified in the 
ROUTE-SETUP message. As it traverses the proposed route, routing tables are created in each node 

ST"? t ?^™ a ?™, d B baCkWard 8diaCent nQde connec±ons M"0 indicated by entries ,n the routing 
,« R0UTE - SETUP « «• o' two replies: ROUTE-SETUP-REPLY message or ROUTE? 

»s FAILURE message. 

5. RQVTE-?ETUP-REPLY Message This message is issued from the destination back to the source 
on a successful creation of a route. 

6. The R2UTE. FAILURE. Me^g is returned for a failed ROUTE-SETUP attempt, and for the failure 
of an element m a successfully-created route. In the case of a failed ROUTE-SETUP attempt' when a 

Tw!Su£ nn0t to <0rWard *• R0UTE - SET UP message to its neighbour, it creates a 

ROUTE-FA LURE message. This message, illustrated in Rgure 8. is returned to the source to be forwarded 
l!^°T? y '"Si? 6 ™ S R0 ^-FA.LURE message indicates which node detected the inoperative 
network resource. The topology data base records the status of the inoperative element (ie. L3) anddoaS 
£1 k ?^? 0th9r R0UTE - SET U p tempts until subsequently informed that the element is 
SSEL?r ? «™ E *^<™ ,E « AmE meSS ** B 'n the case of the failure of an e.ement 1 
established route, the same ROUTE-FAILURE message is created, and for the same purpose, but in this 
case, rt is sent to both participating end nodes. 

«on J^L ^fr^ENT-OPFRATrVF Mggsaae. j. seated by a node when it detects the reactiva- 
2 ^ ROUtSSup^^ ROUTE-ELEMENT-OPERATIVE message is created and sent provided 
munSSSS^SSS Pn0r to etemont chan9ing hon) inoperative 10 Th « 

r«Z , «T u m0SS89e traverses «» back to the origin node by using the 

routing table entnes from the earlier ROUTE-SETUP MESSAGE. 

needed 8 ftfe^^L ^ff^?' 8 I"?* 98 * °" *" f0Ute t0 ^ is no longer 

TalLifin I T efld " P °" rt8 <erther or dejrtina *> n all sessions assigned 

rude 7£ in^TL I h ™ f^. * me «OUTE-DELETE message traverses the network, each 
node in its path frees the routing table entries assigned to that specific route and forwards the messaoe on 
me route be,ng deleted. The ROUTE-DELETE message has no effect on the element ^nZ w£v 

XSSSiSST ° n,y iSSUeS m *** 6,ement **** iS - ^ed fTS 

40 Re 5P ur C9 SlaiS, Each element (node, link) can have three states: UNKNOWN-ASSUMpd npeo. 

AT.VE (UNK,. OPERATIVE (OP). or INOPERATIVE (MOP). > an elements in tS OP o UNK s^e H « 

i ?: rj^suts " ,n - ,nop -* - — * — - — * -~ 

a) UNKNOWN-ASfi^M^p QPERATIVF STATE SgTTINfi 

<s 1) All elements are considered UNK when the topology data base is activated as is a new 

etement when added to an already existing topology data base. as is a new 

but closer 2£ to^T iLT*^ " C " an9ed 40 UNK " " 8,hBr element °" 108 «» IN ° P » 
but closer to the topology data base also fails. This is done to ensure that an element does not stav INOP 

» ^nTou^T 3 R0UTE - ELEMENT - 0P ^ report couW not reach »e 

b) OPERATIVE STATE SETTING 

1) elements change from UNK to OP when a ROUTE-SETUP-REPLY message is received 
routi^ip ° m ,N ° P to ° P 80 e,9ment " hich P™"* the succ ss of a 

mes^'e ^ teC ° meS 0P6ratiV6, CaUSin9 * 9enerati0n <* 8 ROUTE-ELEMEr^OPERlTrVE 
C) INOPERATIVI- gTATF SETTING 

tar in. wsrlfiwi R OUTE-FAILURE resulting from a ROUTE-SETUP attempt causes a state change to INOP 
for the identified -noperabve element over which the ROUTE-SETUP could not be forwarded 
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2) A ROUTE-FAILURE notification on an active route causes a state change to INOP for the 
identified failed element 

10. Node Routing Tables. 

Each network node contains a nod routing table which is used to route messages through th network. The 
node routing table is constructed dynamically as required by routes, using the ROUTE-SETUP mechanism. 
Each entry consists of forward and backward pointers to the outbound queues associated with the "next 
leg" of the message journey in each direction as well as the status or state of the entry. If the node is the 
source or destination node for the route, this is also indicated in the table entry. 

There are two states that each node routing table entry can have: OP or INOP. The OP state is set when 
the route is created. The INOP state is set by the following conditions: 

a) A ROUTE-FAILURE notification is returned from a ROUTE-SETUP attempt 

b) A ROUTE FAILURE notification is received on an active route. 

The state entry in the routing table can be used by an operator for information purposes (eg. operator 
enquiries), and by a node to cut off further messages on an established route that has a ROUTE FAILURE 
message propagating back to it thus freeing valuable link time. 

11. PrgQ£2i§ 

The feedback mechanism of the preferred embodiment of the present invention incorporates certain 
protocols to ensure proper notification of the topology data base(s) about the status of resources on a 
dynamically created route within a network. 

These protocols are described using four cases covering critical network events. They are: 

1) The notification of the topology data base when a failed element (one in a previously used 
route) becomes reactivated. 

2) The double failure case where two elements fail on an active or pending-active route. 

3) The discovery of an inoperative element during a ROUTE-SETUP attempt. 

4) The failure of an element in a pending-active route after the ROUTE-SETUP message has 
passed the failing link but before the ROUTE-SETUP-REPLY has been returned over the failing link. 



Caga ii Route Failure and Subsequent Notification After Recovery 

Assume that a dynamic route A-L1-B-LJ2-C-L3-D-L4-E has been created in the network 110 depicted in 
Figure 10 for a session between nodes A and E. In nodes A, B. C, D. and E the route table entry states are 
OP. Assume that a topology data base 112 was utilised, at node A, to choose the route elements 
comprising this route and that the states of all the network elements in the database are OP. The rules of 
operation are as follows, assuming a failure of link L2 and considering the processing at nodes B and A. 
The processing at nodes C and E would be similar. 

a) The failure of L2 is detected by both nodes B and C. 

b) In this example Node B creates a ROUTE-FAILURE message and sends it to Node A for 
forwarding to its topology data base. 

c) As the ROUTE-FAILURE notification traverses the network to node A. the routing table entry for 
that route in each node In the direction away from the failed element (ie. B to A) is marked INOP but 
remains in the node routing table. 

d) The ROUTE-FAILURE notification causes the topology data base at A to mark the link L2 as INOP 
so that It is not subsequently used to initiate another ROUTE-SETUP attempt through L2. 

e) When link L2 becomes operative, node B searches its node routing table to find the entries which 
are marked INOP and which previously utilised L2 in their outbound path. Then node B creates ROUTE- 
ELEMENT-OPERATIVE messages for the routes corresponding to each such entry. In this example the 
ROUTE ELEMENT OPERATIVE message indicates that L2 is now OP and Is transmitted along the route 
back to node A. Each node in the path, upon forwarding this ROUTE-ELEMENT-OPERATIVE message 
deletes the route's existing INOP entry from its node routing table. 

f) When the ROUTE-ELEMENT-OPERATIVE message reaches node A. it is forwarded to the 
topology data base supporting Node A. The topology data base then updates its element status for L2 to 
OP so that L2 can be used for a new ROUTE-SETUP attempt 

Similar processing occurs in th opposite direction from node C to node E. including node D, and to the 
topology data base supporting node E if different from that of Node A. 
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CASE 2: DOUBLE FAILURE CASE 

Consider the same network depicted in Figure 10. Assume again that a route was created from A to E 
through each node using L1, L2, L3 and L4. Consider the following events: first link L3 fails, then link 12 
5 fails. The following will occur. 

a) Node C detects L3 failure. Node C scans its node routing table and when it finds an entry with an 
utbound link of L3. it sends a ROUTE-FAILURE notification in the revers direct n (ie. to node B). The 

routing table entries in nodes C. B, and A are left in the routing tables but are marked INOP. At node A. the 
ROUTE-FAILURE message is given to the topology data base where the element entry for L3 is marked 
io INOP. Similar processing is performed in the direction of node E and node D detects the L3 failure. 

b) When, subsequently, node B detects 12 failure, it scans its node routing table, sends a ROUTE* 
FAILURE identifying L2 as failed to A using the operative part of what is known to be an already inoperative 
route. Node A forwards this notification to the topology data base. Both nodes A and B leave their routing 
table entries in the INOP state. 

T6 c) When the topology data base receives this second ROUTE-FAILURE notification for the same 

route, although for a different failed element, it scans its topology data base and marks the original failed 
element (L3) as UNK, unless L3 is known to be INOP because of its presence in another route, and marks 
the newly-failed element (L2) as iNOP. At this point, several conditions can occur, dealing with the time at 
which L2 or L3 becomes operative. Each condition is described below. 

20 1) Assume L2 becomes operative while L3 remains inoperative. When L2 becomes operative, node B 

uses the method described in Case 1 to notify the topology data base that 12 is now available. Also, the 
routing table entires in B and A are deleted. The topology data base then marks 12 as OP. A ROUTE- 
SETUP request can be sent to establish the route (assuming a session wants to use the route) and will fail 
at the L3 link. 

25 The partially-constructed route segment will remain, awaiting L3's becoming operative again. 

2) Assume L3 becomes operative but L2 does not. In this case, the topology data base does not get 
the notification since 12 is not operative and blocks the path to origin Node A. This does not cause 
problems, however, because the topology data base had assumed L3 was operative (ie, UNK) after 12 
failed, anyway. 

30 3) Assume L3 becomes operative, followed by 12 becoming operative. This is handled as in items - 

(2) and (1) above except that now ROUTE-SETUP succeeds because L3 is operative. Processing of this 
double failure from the point of view of nodes D and E is similar to B and A except in the opposite direction. 
Node routing table entries in nodes D and E are marked as INOP for traffic flowing in the direction toward 
the failure. 

as Note: When a routing table entry becomes INOP in both directions, the entry is deleted from the table. In 
this case the node has become isolated by failure on each side somewhere along the route, and routing 
table entries are not needed for later ROUTE ELEMENT OPERATIVE notification. In this case, Node C 
deletes its routing table entry, and only nodes B and D transmit a ROUTE ELEMENT OP message to the 
route endpoint. 

40 

CASE 3: DISCOVERY OF AN INOPERATIVE FLFMFNT DURING A ROUTE-SETUP ATTEMPT 

This case is similar to Case 1 processing except that rather than a ROUTE-FAILURE notification being 
issued on the existing route, the failure notification becomes part of the ROUTE-SETUP failure notification. 
As in Case 1, the element in the topology data base which stopped the ROUTE-SETUP attempt is marked 
INOP. When the inoperative element becomes operative, then the same processing as described in Case 1 
items (e) and (f) is done. 



£A§i 4: FAILURE QF A R^SQyiRgE AFTER A ROUTE-SETUP MESSAGE HAS PASSED THE JUST 
FAILED ELEMENT 

This case is similar to Case 1 except that failur notification is for a pending-active node routing table 
entry (since ROUTE-SETUP-REPLY has not been received) instead of for a fully-activated entry. Processing 
is the same for the adjacent node detecting the failure. The notification that the failed elem nt has become 
operative occurs as stated in Case 1 items (e) and (f). 
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The above protocols may be implemented, as mentioned previously, in virtually any dynamic routing 
network to effect th principles of the preferred embodiment of the present invention. Additional standard 
expedients may be added as desired, for xample, implementation of message codes, operator status 
inquiry commands for routing table entry values, and the like. 



HANDLING OF FULL ROUTING TABLES IN NETWORK NODES 

During network operation one or more network nodes might have their routing tables filled to capacity, 
such that no further routing entries can be made in those nodes until the condition is alleviated. The normal 
way for such alleviation to occur is for sessions to end and for routes that are no longer being used to be 
deleted from the network. It may also be desirable to have a topology data base intervene automatically to 
delete route segments that are awaiting the reactivation or recovery of some resource, or to have a network 
operator request a topology data base to perform such an intervention. 

Accordingly, it is possible to incorporate notification to a topology data base of the occurrence of a 
routing table condition of "full" in a network node. The network node sends a message indicating the full 
routing table condition to its controlling node, which in turn passes the message to the topology data base 
in that controlling node. The topology data base either cancels outstanding route requests involving the 
affected node or requests manual intervention by the network operator in making the decision, depending 
on initial settings in the topology data base. In the former case, notification to the network operator may be 
given even though no operator decision is necessary. 

If the topology data base itself or the network operator decides to remove pending route requests from 

the network, the topology data base sends the appropriate ROUTE DELETE request(s) along the 

established route segments) to delete those entries from the routing tables of the nodes in the route 
segment 

REMOVAL OF NODES FROM THE NETWORK 

A network operator can decide to temporarily or permanently remove a link or node from the network. 
Such a link or node resource might be currently active or might be awaiting reactivation or recovery from an 
earlier failure. Accordingly, an operator command to the topology data base may be included to remove the 
representation of a resource from the network. 

If the resource is active, user sessions dependent on the resource may be terminated or allowed to end 
normally, after which routes that include the resource are deleted in the normal manner by 
ROUTE^ DELETE requests from a topology data base. After receiving a command to remove a resource in 
new ROUTE_SETUP requests. 

If a link or node resource is awaiting reactivation or recovery when it is removed from the network, 
pending route requests dependent on the resource are cancelled. After receiving a command to remove a 
resource from the network, the topology data base issues ROUTE_DELETE requests for all pending route 
requests involving the removed resource and does not attempt to establish any new routes using that 
resource. 

The present invention, as illustrated by the above description of embodiments thereof, provides a 
system for notifying a network topology data base of the availability of potential communication among the 
various elements of a communication network with greatly reduced network traffic as compared with prior 
art approaches. The considerable proliferation of status messages in the network is greatly reduced by the 
application of the present invention, and a minimal but sufficient class of nodes is given necessary 
availability information to create session routes efficiently and with a minimum of unnecessary utilisation of 
network resources. 

While the invention has been described with reference to preferred embodiments thereof, H will be 
understood by those skilled In the art that various changes in form and details may be made without 
departing from the scope of the appended claims. 
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Claims 

1. A digital data message transmission network of interconnected message transmitting/receiving nodes 
(12.14.16.18.20) and communication Unks (32,34,36.40,44), collectively "network el ments", at least one 
node being adapted, in operation, to maintain a topology data base (112) recording the potentially availabl 
communication routes through the network and the status of the network elements thereof, each node being 
adapted to:- 

when requiring to originate the transmission of a message through the network, interrogate or have 
interrogated the topology data base to ascertain a suitable route; 

when connected into a route, whether or not that route is eventually completed, record for itself, the next 
preceding and succeeding network elements of and for that route; 

when detecting the failure of any next adjacent link or node, either in the attempted establishing of a route 
or in the use of an already established route, to originate a ROUTE FAILURE MESSAGE identifying the 
failed network element and transmit such message on the recorded network element for that route directed 
away from the failure; 

when receiving a ROUTE FAILURE MESSAGE, to retransmit the same along the route in the same 
direction, if internal to that route, or to the topology data base, if terminal to that route, or to update the 
topology data base for that route, if maintaining the topology data base, in respect of the status thereof; 
whereby the route maintenance message traffic within the network is limited while ensuring that the 
topology data base associated with the origin of a route that does not establish and the topology data base 
or bases associated with both ends of all failed established route incorporating that failed element are 
correspondingly updated. 

2. A network as claimed in claim 1, wherein each node is adapted, when detecting the return to 
availability of a next adjacent node or link, to generate a ROUTE ELEMENT OPERATIVE message so 
indicating and handled in the same manner as a ROUTE FAILURE message. 

3. A network as claimed in claim 2, wherein there are three available status types for each network 
element in the topology data base. OPERATIVE. INOPERATIVE and UNKNOWN/(ASSUMED OPERATIVE), 
the default status being UNKNOWN, which status is switched to the appropriate other status in response to 
ROUTE FAILURE and ROUTE ELEMENT OPERATIVE messages, and INOPERATIVE status being returned 
to UNKNOWN status in response to ROUTE ELEMENT OPERATIVE messages which relate to an element 
inboard on a route of INOPERATIVE elements. 

4. A network as claimed in any preceding claim, wherein the topology data base is additionally loaded 
with the characteristics of the network elements, and a node requiring to originate a route is arranged to 
generate a ROUTE REQUEST message specifying the origin node identity, the destination node identity 
and the desired route characteristics, the node servicing the or the associated topology data base 
interrogating the base in response to such a message to determine a "best-fit" operative route, which may 
be one already established or a new route, and generates a corresponding ROUTE-SETUP message, 
defining the selected route identity and route elements in order, at least for a new route, such ROUTE- 
SETUP message being propagated along the selected route, insofar as is possible. 

5. A network as claimed in claim 4, wherein each node is adapted, upon receipt of a ROUTE-SETUP 
message, to record at least the route identity and the two next adjacent elements in that route. 
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Description 

The present invention relates to digital data message networks and the establishing of communication 
paths therein in which the communication path, or route, that a message takes through the network is 

5 computed dynamically, that is, the path is determined anew each time a communication session between 
two users of the network is attempted to be established. 

Communication networks are arrangements of computers, communication controllers and associated 
peripheral equipment and links which allow "end users" located at remote locations in the network to 
establish and maintain communication of information. An end user in this context may be a human user at 

10 some type of terminal, or an application program running on a host computer or on some type of intelligent 
device controller (ie, workstation, personal computer, display controller, etc). Figure 1 illustrates a small 
communication network 10. In it, two IBM System 370 host computers 12, 14 and three IBM 3725 
Communications Controllers 16, 18, 20 are interconnected, supporting five terminals 22, 24, 26, 28, 30 
connected as shown. Communication links 32, 34, 46, 38, 40, 44. interconnect the computers 12, 14 and 

1$ controllers 16, 18, 20 as shown. 

Communication between, say, terminal 30 and host computer 12 in Figure 1 would be possible over 
several different paths. In order to visualise the communication in a network, a convention has been adopted 
in which the computers and communication controllers in a network are referred to collectively as nodes 
and the connections between nodes as links. End-user devices, whether displays, printers, etc are referred 

20 to collectively as terminals. Figure 2 depicts a node and link diagram of the network 10 shown in Figure 1, 
with like elements in Figure 2 having the same reference numerals as in Figure 1, but primed. Terminals 
are not shown in the diagram, since they are not directly involved in the communication establishment and 
control process to which the present invention is related. 

A conversation, called a session, between an end user at terminal 30 and an application program in 

25 host computer 12 in Figure 1 would involve communication between nodes 12 and 18. or 12' and 18' in 
Figure 2. Several different paths are possible for such a session. For example, communication could be 
simply via link 34', or the path could involve links 32' and 40' and node 16'. Alternatively, the path could 
involve links 32'. 36' and 38' and nodes 16' and 14'. The choices increase with the size and complexity of 
the network. 

30 Except in very limited circumstances in which the network is fully connected, the information input at an 
origin node (supporting one end user) travels through one or more intermediate nodes before reaching the 
destination node (supporting the other end user). Information transmitted by one node and directed to 
another node must travel over the links interconnecting the nodes. In some networks, all information 
transmitted between two end users during a specific communication session traverses the same path, 

35 called in that case a route. The mechanism used to create the route, hereafter called the route mechanism, 
is dependent on a specific network architecture. 

Most network routing mechanisms use routing tables in each node (origin, intermediate, and destination) 
to forward messages to the next node. Routing mechanisms may vary but several use an index into a 
routing table (the index being either a route identifier or a combination of source and/or destination node 

40 identifiers) to specify to which outbound link, and therefore to which next adjacent network node, the 
message is to be sent. Naturally when the message reaches the destination node, but is instead processed 
by the end user. 

The routing tables in each network node can be established either statically or dynamically. In the static 
case, the routing definitions are fixed when network operating is started. The static mechanism is not 

45 relevant to the invention and will therefore not be discussed. 

In dynamic routing, a route creation technique is employed that dynamically creates an end-to-end 
route, from the source node to a destination node, which can be used during a specific communication 
session. This end-to-end route remains defined and active until all sessions using the route terminate. Then 
the route can be eliminated to free network resources, such as routing table entries to be used for other 

so dynamically created routes. 

Several methods can be used to create dynamic routes within networks. One such method, disclosed in 
Proce dings of the Seventh International Conf rence on Computer Communication, Sydney, 30.10.- 
2.11.1984 Els vier Pub., Amsterdam, NL; J.H. Jaffe et al.; "Applying dynamic routing for a g n ral network 
architecture", pages 716-721, employs a topology data base which contains the identity of all physical 

55 nodes and links in th network, including their connectivity, status, and physical characteristics to build a 
route dynamically. This method selects appropriate nodes and links based on their recorded status and 
creates a message, hereafter called a ROUTE SETUP message, containing a list of the nodes and links to 
be used in the rout The ROUTE SETUP messag travers s each node in th list, allowing each node to 
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build an entry in its routing table so that subsequent messages for a session assigned to the route can 
traverse the same physical nodes identified in the ROUTE-SETUP message. Both forward and backward 
pointers are placed in the node routing table. 

Routing in communication networks is discussed by Jaffe et al in "SNA Routing: Past, Present and 

6 Possible Future" appearing in the IBM Systems Journal, Vol. 22, No 4 (1983), Tymes in "Routing and Flow 
Control in TYMNET" appearing in the IEEE Transactions on Communications , Vol. COM-29, No 4, (1981), 
and by McQuillan et al in "The New Routing Algorithm for ARPANET" appearing in the IEEE Transactions 
on Communications , Vol. COM-28, No 5, (1980). 

Clearly, it is important for the topology data base to have current information as to which nodes and 

10 lines are available for communication. Otherwise, attempts might be made to create routes which have 
unavailable nodes or links, and several route creation attempts might be necessary before an available route 
is actually found. This represents an unnecessary waste of network resources. Other than by manual, 
operator input, the reporting of the initial status, failures and reactivations of the network nodes and links, 
hereafter called network elements, has been done by the broadcast of status changes by adjacent nodes. 

is The Tymes and McQuillan et al articles mentioned above describe such broadcast update methods. These 
broadcast status updates have the advantage of not requiring operator intervention. However, they have the 
problem, especially in large and complex networks, of considerably increasing network overhead traffic. In 
some situations, it is preferable to accept less than perfect knowledge of the network status in order to 
reduce this overhead. In fact, it is necessary in such networks to have some mechanism to "kill" the 

20 broadcast message which propagates throughout the system, or else the message reverberates throughout 
the network forever. Typical mechanisms include the incorporation of a cutoff time, after which the message 
is discarded from the network. However, even with such limiting mechanisms, status update messages 
occupy a large proportion of the overall network message-handling capability, such that there is less 
capacity available for users messages. 

25 Thus, it is apparent that there is a need for a means for updating a topology data base in a dynamic 
routing environment such that there are significantly reduced demands on the message handling capability 
of the network as compared with prior art schemes for updating topology data bases. 

Accordingly, the present invention provides a digital data message transmission network comprising 
nodes connected by links, wherein a message travels between a source node and a destination node along 

30 a route comprising a sequence of nodes and connecting links, said network including means for maintaining 
a topology data base recording the potentially available communication routes through the network and the 
status of the network nodes and links; each node being adapted to maintain a routing table and: when 
acting as a source node, obtain a route from the topology database and send a ROUTE SET-UP message 
along the route to thereby establish the route; respond to a ROUTE SET-UP message by recording an entry 

35 in its routing table with the identity of the route and the links and/or nodes therein that are immediately 
adjacent to that particular node; said network being characterised in that each node is further adapted to: 
detect any failure of an immediately adjacent node or link in the route either whilst attempting to establish 
the route or after the route has been established, and in response thereto (i) record the status of the route 
as inoperative in the respective entry in the node's routing table, said entry remaining substantially intact; 

40 and (ii) transmit a ROUTE FAILURE message identifying the failed node or link along the route in the 
opposite direction to the failed node or link; respond to a ROUTE FAILURE message by (i) forwarding said 
ROUTE FAILURE message along the route in said opposite direction; and by 

(ii) further recording the status of the route as inoperative in the respective entry in the node's routing table, 
said entry remaining substantially intact; and when acting as a source or destination node, additionally 
45 forward said ROUTE FAILURE message to the topology data base for updating the recorded status of the 
network nodes and links. 

The present invention further provides a method of controlling a digital data message transmission 
network as set out in claim 5. 

Such an arrangement greatly reduces the overall status message traffic in even a complex communica- 
so tion network by ensuring that only the specific nodes involved m the use of an element are informed of the 
current status of that element. 

The present invention will be described further by way of xample with refer nee to preferred 
embodiments of the inv ntion, as illustrated in the accompanying drawings, in which: 
FIG. 1 is a block diagram of a simple mesh type communication network; 
55 FIG. 2 is a schematic representation of the network shown in FIG. 1; 

FIG. 3 is a sch matic representation of a topology data base route table used by th network of Fig. 1 ; 

FIG. 4 is a schematic representation of a rout statement; 

FIG. 5 is a schematic representation of a ROUTE REQUEST m ssage; . 
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FIG. 7 is a schematic representation of a ROUTE-SETUP message; 

FIG. 8 is a schematic representation of a routing table; 

FIG. 9 is a schematic representation of a ROUTE FAILURE message; and 

FIG. 10 is a schematic representation of a network with a topology data base. 
5 In the drawings, like elements are designated with similar reference numbers, and identical elements in 
different specific embodiments are designated by identical reference numbers. 

The present invention incorporates a method and apparatus which can be used to dynamically report 
the status of the network nodes and links to topology data bases so that ROUTE-SETUP messages can be 
created efficiently with knowledge of the physical route element status. The description that follows is 
to applicable to an IBM SNA network comprising, for example, IBM System 370 computers and IBM 3725 
Communication Controllers as nodes, and suitable communication links for network interconnection. How- 
ever, the principles and protocols are presented with sufficient generality to enable application to any 
communication network having dynamic routing that relies on one or more topology data bases for route 
creation, and local routing tables at each node for the establishment and maintenance of communication 
is sessions. 

In the preferred embodiment, each topology data base is initially set up with information as to all of the 
nodes and links, and their potential connectivity to adjacent nodes. This information is entered by way of 
conventional input statements either interactively or via batch definitions. The link and node statements 
further specify certain characteristics, such as line(link) transmission speed, node buffer size, and element 

20 data transmission security, which are used by end users to request a route. These characteristics are set 
forth below under RULES OF OPERATION, DEFINITIONS & STATES, part a) Data Types. Additionally, 
each network element in the topology data base is initially marked as "assumed operative", or available. 
This initial status has nothing to do with the actual status of the corresponding elements, but allows the 
route selection technique to select the element for a route setup attempt and dynamically ascertain its 

25 actual operative or inoperative status via the feedback mechanism. The information is stored conventionally, 
in such a way as to be available for scanning and comparing when a route request is received. 

This information is entered for 1) routes, 2) links, and 3) nodes. Thus, assuming the interactive input 
method (as opposed to batch), a route statement is used to enter information defining a route between two 
nodes between which communication is to be allowed. This statement specifies the links and nodes, in 

30 order, in that route, and an identifier (ID) for that route. For each pair of nodes that may communicate, as 
many route statements as there are distinct routes between those nodes may be entered. Figure 3 
illustrates the topology data base entries for the potential routes between nodes 16' and 14' in Figure 2. In 
this case there are three such routes: 50, 52, and 54. Figure 4 illustrates the form of a route statement 58. 
Link and node names 60 are placed in the sequence in which a message traverses that route, starting with 

35 the origin node and ending with the destination node. The statement type 62 identifies the statement as a 
route statement. 

Figure 5 illustrates a link statement 64 and a node statement 66, showing the various fields 68, 70 
identifying the element and containing data for the aforementioned characteristics. The statement type 72, 
74, identifies the statements as link or node statements, respectively. The information entered via the route, 

40 link and node statements is conventionally stored in such a way as to be available for scanning and 
comparing when a route request is received, so as to, first, retrieve ail routes identified between the 
specified end nodes, and, second, find the best match of characteristics for the elements in the selected 
routes against the specified characteristics and thereby select the best route. 

When an end user desires to communicate with another end user, a session is requested of the control 

45 program resident in the origin node. The session request includes the names of the source and destination 
nodes supporting the end users and a class of service. The class of service is a conventional shorthand for 
a set of the aforementioned characteristics of the route to be selected. In the preferred embodiment, the 
information in the session request is forwarded in a message, hereafter called a ROUTE REQUEST 
message, to the nearest available topology data base for the selection of a route. Figure 6 illustrates a 

so ROUTE REQUEST message 76. It comprises a request code 78, identifying the message as a ROUTE 
REQUEST, the origin node name 79, the destination node name 80, and the class of service name 82. 

Upon receipt of th ROUTE REQUEST message, the topology data bas selects a potential route 
whose elements conform to the characteristics identified in the specified class of service. If a route with the 
same exact set of elements is already in use with the same charact ristics, the session will b assigned to 

55 the already created route. If a route has not already been cr ated. th topology data base is scanned to 
select the best route between the source and destination nodes, based on th match of actual element 
characteristics against the characteristics requested. Only nodes and links which ar assumed or known to 
be op rativ can be selected in this process. Th set cted route is th n described in a m ssage containing 



5 



EP 0 221 360 B1 



a list of nodes and links comprising the route, along with a unique route identifier (route ID) for that route, 
hereafter called a ROUTE-SETUP message. Figure 7 illustrates a ROUTE-SETUP message 84. The request 
code 86 identifies the message as a ROUTE-SETUP message. The route ID 87 identifies the route. The 
node names and link names 88 appear in the sequence a message travels on the route, as in the route 

5 statement 58 (Figur 4, supra). 

Route elements are assumed initially to be operative, because when the topology data base is 
activated, the status of each network element is unknown. Rather than initially obtaining the status of each 
element defined in the topology data base through operator input, exchanges with other data bases, or 
queries of each network element, the status is learned as sessions are requested by using the preferred 

io embodiment of the present invention herein described. 

As the ROUTE-SETUP message traverses the network, each active node creates routing table entries in 
conventional fashion for both directions of the communication. That is, when the ROUTE-SETUP message 
is processed, an entry is made in the routing table, containing the route ID (including origin and destination 
node names or addresses) and the outbound link address. As is known, this permits quick routing of 

75 messages thereafter via the route ID accompanying the message. When a message arrives with this 
information, a simple table scan yields the outbound link address, which is sufficient for sending the 
message on its way. 

In an alternative embodiment, the route ID is reduced to a single Local Path Identifier (LPID) in each 
node, which may be a sequentially selected number starting with zero that is assigned to a route as the 

20 ROUTE-SETUP message for that route arrives. The LPID is entered into the table, and sent back to the 
previous node for entry into that node f s routing table. Each routing table, in this embodiment, has the LPID 
it assigns, the outbound link to the next node, and the LPID assigned by the next node in the route. When a 
message arrives at a node in this embodiment, the LPID for that node is extracted from the header and 
used to locate the table entry for that session. The next node's LPID, located in the table, is then exchanged 

25 for the incoming LPID. The message is then sent on to the next node via the assigned outbound link, and 
so forth. Figure 8 illustrates a routing table 90 including a unidirectional entry 88 for a hypothetical route, 
using the LPID method. As shown, there are three elements to an entry, an LPID 94, the outbound link ID 
96, and the LPID for the next node 98. 

After the information necessary for the routing table entry is extracted from the ROUTE-SETUP 

30 message, it is sent on to the next element, and so on, to create all of the necessary table entries for the 
route. It all nodes and links in the end-to-end route are active, the ROUTE-SETUP will be successful and an 
end-to-end route will be created. 

Each routing table entry in each node traversed is marked as operative. If a node cannot forward the 
ROUTE-SETUP message to the next node because either the link to that node or the node itself is 

35 inoperative, then a ROUTE FAILURE message identifying the inoperative link or node is generated and 
returned to the route origin for forwarding to the topology data base. The inoperative status is marked in the 
topology data base and that network element is not used in subsequent ROUTE-SETUP messages until its 
status changes. 

As the ROUTE FAILURE message returns through each node identified in the ROUTE-SETUP, each 
40 node's routing table entry remains intact, with the status of the route being marked as inoperative. These 
table entries are used for the feedback mechanism to the end node (and its topology data base) when the 
failed element is re-activated. The ROUTE FAILURE message is transmitted by following the node routing 
table entries set up from the failed ROUTE-SETUP message. Figure 9 illustrates a ROUTE FAILURE 
message 100 for an LPID-based network. It includes a Request Code 102 identifying the message as a 
45 ROUTE FAILURE message, the node ID of the node detecting the failure 104, Failed Element ID 106, and 
Next LPID 108. 

When the node that reported the ROUTE FAILURE (the "adjacent node" detects that the inoperative 
element subsequently has become operative, a ROUTE ELEMENT OPERATIVE message is created and 
sent to the origin node for forwarding to its topology data base. The topology data base then resets that 
so element's status entry to operative. The element is then available for subsequent ROUTE-SETUP attempts. 
The ROUTE ELEMENT OPERATIVE message is identical to a ROUTE FAILURE message (100. Fig. 9), 
except that the Request Code identifies it as a ROUTE ELEMENT OPERATIVE messag . 

If more than one route had attempted to use the inoperative element, more than one set of routing table 
entries would have be n created in the adjacent node and for as many of those sets of entries as had been 
55 creat d. ROUTE ELEMENT OPERATIVE messages would be created and sent back to the corr sponding 
origin nodes for resetting of their topology data base entries for that element to operative. 

This notification flows to th route origin nod by following the node routing tabl entries set up from 
the failed ROUTE-SETUP message, in the same manner as th ROUTE FAILURE message. 
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The same process is used after an end-to-end route is successfully established and a failure occurs on 
a link or node in the route. The same ROUTE FAILURE message is returned, in this case to both end 
nodes, the origin and the destination node, for forwarding to the topology data base of each end node. The 
ROUTE FAILURE message identifies the failing element, and as in the initial case of failure to s t up the 

5 route, the routing table entries in the route segments to the end nodes remain intact as the message travels 
back to the end node. As in the previous case, when the failed element becomes operative, the node 
routing table entries are used by ROUTE ELEMENT OPERATIVE messages (one in each direction around 
the point of failure) to follow the route back to the end node for forwarding to the topology data base(s) to 
indicate the operative status of the network element. 

to In either case, as the ROUTE ELEMENT OPERATIVE messages flow to the topology data base(s), the 
routing table entries are removed from the nodes along the route to recover the routing table space just as 
if the end-to-end route were being normally deleted after the termination of all sessions using the route. 

The feedback mechanism functions in the face of both single point and multiple point failures along the 
route, as described in greater detail below. 

75 The basic elements of the feedback mechanism of the preferred embodiment can be described by a 
set of rules, definitions, states and protocols which may be applied to any communication network having 
dynamic routing of the type herein described. The protocols are described in four operational cases. 



20 



40 



45 



RULES OF OPERATION, DEFINITIONS & STATES 



1 . Topology Data Base. There will exist one or more topology data bases which contain network node, 
connectivity and status data which can be used to select and end-to-end route through a communication 
network. 

For each route element (that is, for each network node, which can be either source, destination, or 
25 intermediate node host or communication processor; and for each link, which can be either teleprocess- 
ing link, channel connection, local teleprocessing loop, Local Area Network, fibre optic line, or any other 
medium which can connect two host or communication processor nodes), there exists a set of 
parameters as follows: 

30 

Element Identifiers Connectivity Characteristics Status 
Node Node Name Adjacent Message Storage Operative 

Node Address nodes Capacity Inoperative 

35 Processing Power UnJtnown/ 

Security (Assumed 
Operative) 



Link Link Name Adjacent Bandwidth Operative 

Link Address nodes Reliability Inoperative 

Security Unknown/ 

(Assumed 
Operative) 



so These characteristics are well known in the art. 

Various methods can be utilised to create the entries and element knowledge in the topology data 
base. Th y include operator input, a system gen ration process, automatic element identification at 
element activation, etc. 

2. Route Selection Algorithm. The aJgorithm(s) utilis d to select a route (ie, secure, least delay, greatest 
55 bandwidth, etc) should not affect the operability of the invention in a network, provided the selection 

algorithm adheres to the rul s for creation of the sel cted route list and element status d scribed above. 

3. Route Request Mechanism. A mechanism is provided to allow a user to request an nd-to-end route 
from source to destination nodes through the network. This request is sent to a topology data base with 
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an indication as to the characteristics (secure, least delay, etc) desired. The request initiates the route 
selection process in the topology data base and creates a ROUTE-SETUP message. 
4. ROUTE-SETUP Message . This is a message which contains the list of nodes and links selected to 
create the end-to-end route from source to destination nodes. The ROUTE-SETUP message traverses 
5 the network, from the source to the destination, node to link to node to link, etc, in the order specified in 
the ROUTE-SETUP message. As it traverses the proposed route, routing tables are created in each node 
traversed, the forward and backward adjacent node connections being indicated by entries in the routing 
table. The ROUTE-SETUP can have one of two replies: ROUTE-SETUP-REPLY message or ROUTE- 
FAILURE message. 

w 5. ROUTE-SETUP-REPLY Message This message is issued from the destination back to the source on a 
successful creation of a route. 

6. The ROUTE FAILURE Message is returned for a failed ROUTE-SETUP attempt, and for the failure of 
an element in a successfully-created route. In the case of a failed ROUTE-SETUP attempt, when a 
network node cannot continue to forward the ROUTE-SETUP message to its neighbour, it creates a 

15 ROUTE-FAILURE message. This message, illustrated in Figure 9, is returned to the source to be 
forwarded to the topology data base. This ROUTE-FAILURE message indicates which node detected the 
inoperative network resource. The topology data base records the status of the inoperative element (ie, 
L3) and does not reuse this element for other ROUTE-SETUP attempts until subsequently informed that 
the element is operative by the ROUTE-ELEMENT-OPERATIVE message. In the case of the failure of an 

20 element on an established route, the same ROUTE-FAILURE message is created, and for the same 
purpose, but in this case, it is sent to both participating end nodes. 

7. The ROUTE-ELEMENT-OPERATIVE Message is created by a node when it detects the reactivation of 
an inoperative element. The ROUTE-ELEMENT-OPERATIVE message is created and sent provided that 
a ROUTE-SETUP message has flowed prior to the element changing from inoperative to operative. The 

25 ROUTE-ELEMENT-OPERATIVE message traverses the network back to the origin node by using the 
routing table entries from the earlier ROUTE-SETUP MESSAGE. 

8. ROUTE-DELETE Message. This message is sent on the route to signal that the route is no longer 
needed. It is created by the route end-points (either source or destination node) when all sessions 
assigned to a specific end-to-end route have ended. As the ROUTE-DELETE message traverses the 

30 network, each node in its path frees the routing table entries assigned to that specific route and forwards 
the message on the route being deleted. The ROUTE-DELETE message has no effect on the element 
status in the topology data base since this message only issues on active routes and the element status 
is not changed from their currently OPERATIVE state. 

9. Resource State. Each element (node, link) can have three states: UNKNOWN-ASSUMED OPERATIVE 
35 (UNK), OPERATIVE (OP), or INOPERATIVE (INOP). If an element is in the OP or UNK state, it can be 

utilised for route selection purposes. In the INOP state, the element cannot be utilised for route selection 
until it is marked UNK or OP. 

a) UNKNOWN-ASSUMED OPERATIVE STATE SETTING 

40 

1) Ail elements are considered UNK when the topology data base is activated, as is a new element when 
added to an already existing topology data base. 

2) An element in the INOP state is changed to UNK if another element on the same INOP route but 
closer to the topology data base also fails. This is done to ensure that an element does not stay INOP 

45 indefinitely because a ROUTE-ELEMENT-OPERATIVE report could not reach the topology data base 
due to a second outage. 

b) OPERATIVE STATE SETTING 

so 1) elements change from UNK to OP when a ROUTE-SETUP-REPLY message is received. 

2) Elements change from INOP to OP when an element which prevents the success of a ROUTE-SETUP 
request becomes op rative, causing the generation of a ROUTE-ELEMENT-OPERATIVE messag . 

C) INOPERATIVE STATE SETTING 

55 

1) A ROUTE-FAILURE resulting from a ROUTE-SETUP attempt causes a state chang to INOP for the 
identified inoperativ element over which the ROUTE-SETUP could not be forwarded. 

2) A ROUTE-FAILURE notification on an active rout causes a state change to INOP for the identified 
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failed element. 

10. Node Routing Tables. 

Each network node contains a node routing table which is used to route messages through the network. 
The node routing table is constructed dynamically as required by routes, using the ROUTE-SETUP 
mechanism. Each entry consists of forward and backward pointers to the outbound queues associated with 
the "next leg" of the message journey in each direction as well as the status or state of the entry. If the 
node is the source or destination node for the route, this is also indicated in the table entry. 

There are two states that each node routing table entry can have: OP or INOP. The OP state is set 
when the route is created. The INOP state is set by the following conditions: 

a) A ROUTE-FAILURE notification is returned from a ROUTE-SETUP attempt. 

b) A ROUTE FAILURE notification is received on an active route. 

The state entry in the routing table can be used by an operator for information purposes (eg, operator 
enquiries), and by a node to cut off further messages on an established route that has a ROUTE FAILURE 
message propagating back to it, thus freeing valuable link time. 

11. Protocols 

The feedback mechanism of the preferred embodiment of the present invention incorporates certain 
protocols to ensure proper notification of the topology data base(s) about the status of resources on a 
dynamically created route within a network. 

These protocols are described using four cases covering critical network events. They are: 

1) The notification of the topology data base when a failed element (one in a previously used route) 
becomes reactivated. 

2) The double failure case where two elements fail on an active or pending-active route. 

3) The discovery of an inoperative element during a ROUTE-SETUP attempt. 

4) The failure of an element in a pending-active route after the ROUTE-SETUP message has passed the 
failing link but before the ROUTE-SETUP-REPLY has been returned over the failing link. 

Case 1: Route Failure and Subsequent Notification After Recovery 

Assume that a dynamic route A-L1-B-L2-C-L3-D-L4-E has been created in the network 110 depicted in 
Figure 10 for a session between nodes A and E. In nodes A, B, C, D, and E the route table entry states are 
OP. Assume that a topology data base 112 was utilised, at node A, to choose the route elements 
comprising this route and that the states of all the network elements in the database are OP. The rules of 
operation are as follows, assuming a failure of link L2 and considering the processing at nodes B and A. 
The processing at nodes C and E would be similar. 

a) The failure of L2 is detected by both nodes B and C. 

b) In this example Node B creates a ROUTE-FAILURE message and sends it to Node A, for forwarding 
to its topology data base. 

c) As the ROUTE-FAILURE notification traverses the network to node A. the routing table entry for that 
route in each node in the direction away from the failed element (ie, B to A) is marked INOP but remains 
in the node routing table. 

d) The ROUTE-FAILURE notification causes the topology data base at A to mark the link L2 as INOP so 
that it is not subsequently used to initiate another ROUTE-SETUP attempt through L2. 

e) When link L2 becomes operative, node B searches its node routing table to find the entries which are 
marked INOP and which previously utilised L2 in their outbound path. Then node B creates ROUTE- 
ELEMENT-OPERATIVE messages for the routes corresponding to each such entry. In this example the 
ROUTE ELEMENT OPERATIVE message indicates that L2 is now OP and is transmitted along the route 
back to node A. Each node in the path, upon forwarding this ROUTE-ELEMENT-OPERATIVE message, 
deletes the route's existing INOP entry from its node routing table. 

f) When the ROUTE-ELEMENT-OPERATIVE m ssage reach s node A, it is forward d to the topology 
data base supporting Node A. The topology data base then updates its element status for L2 to OP so 
that L2 can be used for a new ROUTE-SETUP attempt. 

Similar processing occurs in the opposit direction from nod C to node E, including node D, and to the 
topology data base supporting node E if diff rent from that of Node A. 
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CASE 2: DOUBLE FAILURE CASE 

Consider the same network depicted in Figure 10. Assume again that a route was created from A to E 
through each node using L1, L2. L3 and L4. Consider the following events: first link L3 fails, then link 12 
6 fails. The following will occur. 

a) Node C detects L3 failure. Node C scans its node routing table and when it finds an entry with an 
outbound link of L3, it sends a ROUTE-FAILURE notification in the reverse direction (ie ( to node B). The 
routing table entries in nodes C, B, and A are left in the routing tables but are marked INOP. At node A, 
the ROUTE-FAILURE message is given to the topology data base where the element entry for L3 is 

io marked INOP. Similar processing is performed in the direction of node E and node D detects the L3 
failure. 

b) When, subsequently, node B detects 12 failure, it scans its node routing table, sends a ROUTE- 
FAILURE identifying L2 as failed to A using the operative part of what is known to be an already 
inoperative route. Node A forwards this notification to the topology data base. Both nodes A and B leave 

is their routing table entries in the INOP state. 

c) When the topology data base receives this second ROUTE-FAILURE notification for the same route, 
although for a different failed element, it scans its topology data base and marks the original failed 
element (L3) as UNK, unless L3 is known to be INOP because of its presence in another route, and 
marks the newly-failed element (12) as INOP. At this point, several conditions can occur, dealing with the 

20 time at which L2 or L3 becomes operative. Each condition is described below. 

1) Assume L2 becomes operative while L3 remains inoperative. When L2 becomes operative, node B 
uses the method described in Case 1 to notify the topology data base that L2 is now available. Also, 
the routing table entires in B and A are deleted. The topology data base then marks L2 as OP. A 
ROUTE-SETUP request can be sent to establish the route (assuming a session wants to use the 

25 route) and will fail at the L3 link. 

The partially-constructed route segment will remain, awaiting L3*s becoming operative again. 

2) Assume L3 becomes operative but L2 does not. In this case, the topology data base does not get 
the notification since L2 is not operative and blocks the path to origin Node A. This does not cause 
problems, however, because the topology data base had assumed L3 was operative (ie, UNK) after L2 

30 failed, anyway. 

3) Assume L3 becomes operative, followed by L2 becoming operative. This is handled as in items (2) 
and (1) above except that now ROUTE-SETUP succeeds because L3 is operative. Processing of this 
double failure from the point of view of nodes D and E is similar to B and A except in the opposite 
direction. Node routing table entries in nodes D and E are marked as INOP for traffic flowing in the 

35 direction toward the failure. 

Note: When a routing table entry becomes INOP in both directions, the entry is deleted from the 
table. In this case the node has become isolated by failure on each side somewhere along the route, 
and routing table entries are not needed for later ROUTE ELEMENT OPERATIVE notification. In this 
case, Node C deletes its routing table entry, and only nodes B and D transmit a ROUTE ELEMENT 

40 OP message to the route endpoint. 

CASE 3: DISCOVERY OF AN INOPERATIVE ELEMENT DURING A ROUTE-SETUP ATTEMPT 

This case is similar to Case 1 processing except that rather than a ROUTE-FAILURE notification being 
45 issued on the existing route, the failure notification becomes part of the ROUTE-SETUP failure notification. 
As in Case 1. the element in the topology data base which stopped the ROUTE-SETUP attempt is marked 
INOP. When the inoperative element becomes operative, then the same processing as described in Case 1 
items (e) and (0 is done. 

60 CASE 4: FAILURE OF A RESOURCE AFTER A ROUTE-SE TUP MESSAGE HAS PASSED THE JUST 
FAILED ELEMENT ~ " 

This case is similar to Case 1 except that failur notification is for a pending-activ nod routing table 
entry (since ROUTE-SETUP-REPLY has not been rec ived) instead of for a fully-activated ntry. Processing 
55 is the same for the adjacent node detecting th failur . The n tificatton that the fail d element has become 
operative occurs as stated in Case 1 items (e) and (f). 

The above protocols may b implemented, as mentioned previously, in virtually any dynamic routing 
network to effect the principles of the preferr d embodiment of the pr sent invention. Additional standard 
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expedients may be added as desired, for example, implementation of message codes, operator status 
inquiry commands for routing table entry values, and the like. 

HANDLING OF FULL ROUTING TABLES IN NETWORK NODES 

5 

During network operation one or more network nodes might have their routing tables filled to capacity, 
such that no further routing entries can be made in those nodes until the condition is alleviated. The normal 
way for such alleviation to occur is for sessions to end and for routes that are no longer being used to be 
deleted from the network. It may also be desirable to have a topology data base intervene automatically to 
w delete route segments that are awaiting the reactivation or recovery of some resource, or to have a network 
operator request a topology data base to perform such an intervention. 

Accordingly, it is possible to incorporate notification to a topology data base of the occurrence of a 
routing table condition of "full" in a network node. The network node sends a message indicating the full 
routing table condition to its controlling node, which in turn passes the message to the topology data base 
75 in that controlling node. The topology data base either cancels outstanding route requests involving the 
affected node or requests manual intervention by the network operator in making the decision, depending 
on initial settings in the topology data base. In the former case, notification to the network operator may be 
given even though no operator decision is necessary. 

If the topology data base itself or the network operator decides to remove pending route requests from 
20 the network, the topology data base sends the appropriate ROUTE_ DELETE request(s) along the 
established route segment(s) to delete those entries from the routing tables of the nodes in the route 
segment. 

REMOVAL OF NODES FROM THE NETWORK 

25 

A network operator can decide to temporarily or permanently remove a link or node from the network. 
Such a link or node resource might be currently active or might be awaiting reactivation or recovery from an 
earlier failure. Accordingly, an operator command to the topology data base may be included to remove the 
representation of a resource from the network. 
30 If the resource is active, user sessions dependent on the resource may be terminated or allowed to end 
normally, after which routes that include the resource are deleted in the normal manner by 
ROUTE_DELETE requests from a topology data base. After receiving a command to remove a resource in 
new ROUTE_SETUP requests. 

If a link or node resource is awaiting reactivation or recovery when it is removed from the network, 
35 pending route requests dependent on the resource are cancelled. After receiving a command to remove a 

resource from the network, the topology data base issues ROUTE DELETE requests for all pending route 

requests involving the removed resource and does not attempt to establish any new routes using that 
resource. 

The present invention, as illustrated by the above description of embodiments thereof, provides a 
40 system for notifying a network topology data base of the availability of potential communication among the 
various elements of a communication network with greatly reduced network traffic as compared with prior 
art approaches. The considerable proliferation of status messages in the network is greatly reduced by the 
application of the present invention, and a minimal but sufficient class of nodes is given necessary 
availability information to create session routes efficiently and with a minimum of unnecessary utilisation of 
45 network resources. 

Claims 

1- A digital data message transmission network comprising nodes (12, 14, 16. 18, 20) connected by links 
so (32, 34, 36, 40, 44), wherein a message travels between a source node and a destination node along a 

route comprising a sequence of nodes and connecting links, said network including means for 

maintaining a topology data base (112) recording th potentially availabl communication routes 

through the network and the status of the network nod s and links; 

each node being adapted to maintain a routing table and: 
55 when acting as a source node, obtain a route from the topology database and send a ROUTE SET-UP 

message along the route to thereby establish the route; 

respond to a ROUTE SET-UP message by recording an ntry in its routing tabl with the identity of the 
route and th links and/or nod s ther in that are immediately adjacent to that particular node; 
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said network being characterised in that each node is further adapted to: 

detect any failure of an immediately adjacent node or link in the route ither whilst att mpting to 
establish the route or after the route has been established, and in response thereto (i) record the status 
of the route as inoperative in the respective entry in the node's routing table, said entry remaining 
5 substantially intact; and (ii) transmit a ROUTE FAILURE message identifying the failed node or link 
along the route in the opposite direction to the failed node or link; 

respond to a ROUTE FAILURE message by (i) forwarding said ROUTE FAILURE message along the 
route in said opposite direction; and by 

(ii) further recording the status of the route as inoperative in the respective entry in the node's routing 
10 table, said entry remaining substantially intact; and 

when acting as a source or destination node, additionally forward said ROUTE FAILURE message to 
the topology data base for updating the recorded status of the network nodes and links. 

2. A network as claimed in claim 1, wherein each node is adapted, when detecting the return to availability 
16 of an immediately adjacent node or link, to generate a ROUTE ELEMENT OPERATIVE message so 

indicating which is handled in the same manner as a ROUTE FAILURE message. 

3. A network as claimed in claim 2, wherein there are three available status types for each network node 
or link in the topology data base, OPERATIVE, INOPERATIVE and UNKNOWN/(ASSUMED OPER- 

20 ATIVE), the default status being UNKNOWN, which status is switched to the appropriate other status in 
response to ROUTE FAILURE and ROUTE ELEMENT OPERATIVE messages. 

4. A network as claimed in any preceding claim, wherein the topology data base stores information 
regarding the characteristics of the network nodes and links, and a source node sends a ROUTE 

25 REQUEST message specifying the source node identity, the destination node identity and the desired 
route characteristics, to the topology data base, which in response to such a message determines a 
"best-fit" operative route, and generates a corresponding ROUTE-SETUP message, defining the 
selected route identity and route elements in order. 

30 5. A method of controlling a digital data message transmission network comprising nodes (12, 14, 16, 18, 
20) connected by links (32, 34, 36. 40, 44), wherein a message travels between a source node and a 
destination node along a route comprising a sequence of nodes and connecting links, said network 
including means for maintaining a topology data base (112) recording the potentially available 
communication routes through the network and the status of the network nodes and links, each node 

35 being adapted to maintain a routing table; 
said method comprising the steps of: 

a source node obtaining a route from the topology database and sending a ROUTE SET-UP message 
along the route to thereby establish the route; 

each node responding to a ROUTE SET-UP message by recording an entry in its routing table with the 
40 identity of the route and the links and/or nodes therein that are immediately adjacent to that particular 
node; 

said method being characterised by further comprising the steps of: 

each node detecting any failure of an immediately adjacent node or link in the route either whilst 

attempting to establish the route or after the route has been established, and in response thereto (i) 
45 recording the status of the route as inoperative in the respective entry in the node's routing table, said 

entry remaining substantially intact; and (ii) transmitting a ROUTE FAILURE message identifying the 

failed node or link along the route in the opposite direction to the failed node or link; 

each node responding to a ROUTE FAILURE message by (i) forwarding said ROUTE FAILURE 

message along the route in said opposite direction; and by 
so (ii) further recording the status of the route as inoperative in the respective entry in the node's routing 

table, said entry remaining substantially intact; and 

the source node and/or destination node additionally forwarding said ROUTE FAILURE message to the 
topology data base for updating the r corded status of the network nodes and links. 

55 Patentanspriiche 

1. Obertragungsnetzwerk fur digitale Datennachrichten. umfassend Knoten (12,14,16,18,20), die durch 
Verbindungsstrecken (32,34.36,40.44.) gekoppelt sind. bei dem ine Nachricht zwischen einem Quel- 
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lenknoten und einem Zielknoten Idngs eines Leitweges lauft, der eine Folge von Knoten und gekoppel- 
ten Verbindungsstrecken umfaitt, und das Netzwerk Mittel zur Wartung einer Topologie-Datenbank 
(112) einschlieflt, die die moglichen verfugbaren Nachrichtenverbindungs-Leitwege durch das Netzwerk 
und den Status der Netzwerkknoten und Verbindungsstrecken aufzeichnet, 
wobei jeder Knoten eingerichtet ist, um eine Leitwegtabelle zu warten und, : 

wenn er als Quellenknoten dient, einen Leitweg von der Topologie-Datenbank zu erhalten und eine 
Nachricht LEITWEG AUFBAUEN ISngs des Leitweges zu schicken, um dadurch den Leitweg festzule- 
gen, 

auf eine Nachricht LEITWEG AUFBAUEN durch Aufzeichnen eines Eintrags in seine Leitwerttabelle mit 
der Identifizierung des Leitweges und der Verbindungsstrecken und/oder Knoten darin, die dem 
betreffenden Knoten unmitteibar benachbart sind, zu antworten, 

wobei das Netzwerk dadurch gekennzeichnet ist, dafl jeder Knoten auflerdem eingerichtet ist, um : 
jeden Fehler eines unmitteibar benachbarten Knotens Oder einer Verbindungsstrecke in dem Leitweg 
festzustellen, 

entweder wShrend des Versuchs, einen Leitweg festzulegen, Oder nachdem der Leitweg festgelegt 
wurde, und als Antwort darauf (i) den Status des Leitweges als funktionsunfahig in dem entsprechenden 
Eintrag in der Leitwegtabelle des Knotens aufzuzeichnen, wobei der Eintrag im wesentlichen unversehrt 
bleibt, und (it) eine Nachricht LEITWEGFEHLER. die den fehlerhaften Knoten Oder die fehlerhafte 
Verbindungsstrecke identifiziert, langs des Leitweges in der zu dem fehlerhaften Knoten Oder der 
fehlerhaften Verbindungsstrecke entgegengesetzten Richtung zu Ubertragen, auf eine Nachricht LEIT- 
WEGFEHLER durch Ubermitteln der Nachricht LEITWEGFEHLER ISngs des Leitweges in entgegenge- 
setzter Richtung und durch (ii) weiteres Aufzeichnen des Status des Leitwegs als funktionsunfahig in 
dem entsprechenden Eintrag in der Leitwegtabelle des Knotens zu antworten, wobei der Eintrag im 
wesentlichen unversehrt bleibt, und, wenn er als Quelierv oder Zielknoten arbeitet, zusStzlich die 
Nachricht LEITWEGFEHLER zu der Topologie-Datenbank zu Ubertragen, um den aufgezeichneten 
Status der Knoten und Verbindungsstrecken des Netzwerkes auf den neuesten Stand zu bringen. 

Netzwerk nach Anspruch 1, bei dem jeder Knoten dafiir eingerichtet ist, wenn er die Ruckkehr zur 
Verfugbarkeit eines unmitteibar benachbarten Knotens oder einer Verbindungsstrecke feststellt.eine 
Nachricht LEITWEGELEMENT FUNKTIONSFAHIG zu erzeugen, die das anzeigt, welche in der glei- 
chen Weise behandelt wird wie die Nachricht LEITWEGFEHLER. 

Netzwerk nach Anspruch 2, bei dem es drei gOltige Statusarten fUr jeden Netzwerkknoten oder jede 
Verbindungsstrecke in der Topologie-Datenbank gibt, FUNKTIONSFAHIG, FUNKTIONSUNFAHIG und 
UNBEKANNT / (ALS FUNKTIONSFAHIG ANGENOMMEN), wobei der Vorgabezustand UNBEKANNT 
ist, welcher Status zu dem geeigneten anderen Status als Antwort auf die Nachrichten LEITWEGFEH- 
LER und LEITWEGELEMENT FUNKTIONSTUCHTIG umgeschaltet wird. 

Netzwerk nach irgendeinem vorhergehenden Anspruch, bei dem die Topologie-Datenbank Informatio- 
nen bezuglich der Eigenschaften der Netzwerkknoten und Verbindungsstrecken speichert. und ein 
Quellenknoten eine Nachricht LEITWEGANFORDERUNG, die die Identifizierung des Quellenknotens, 
die Identifizierung des Zielknotens und die gewunschten Leitwegeigenschaften angibt,an die Topologie- 
Datenbank abschickt, welche als Antwort auf solch eine Nachricht einen "am besten geeigneten" 
funktionstuchtigen Leitweg bestimmt und eine entsprechende Nachricht LEITWEG AUFBAUEN erzeugt, 
die die ausgewahlte Leitwegidentifizierung und die Leitwegelemente der Reihe nach bestimmt. 

Verfahren zum Steuern eines Obertragungsnetzwerkes fur digitale Datennachrichten, umfassend Knoten 
(12,14,16,18,20), die durch Verbindungsstrecken (32.34,36.40.44) gekoppelt sind, in dem eine Nachricht 
zwischen einem Quellenknoten und einem Zielknoten I3ngs eines Leitwegs lauft. der eine Folge von 
Knoten und koppelnden Verbindungsstrecken aufweist. wobei das Netzwerk Mittel zur Wartung einer 
Topologie Datenbank (112) zum Aufzeichnen der moglichen verfugbaren Nachrichtenverbindungs- 
Leitwege durch das Netzw rk und des Status der Netzwerkknoten und V rbindungsstrecken einschliefit, 
und jeder Knoten eingerichtet ist, um eine Leitwegtabelle zu warten, 
wobei das Verfahren die Schritte umfaflt,: 

dafl ein Quellenknoten ein n Leitweg von d r Technoiogie-Dat nbank rhalt und eine Nachricht 
LEITWEG FESTLEGEN langs eines Leitwegs sendet. um dadurch den Leitw g festzuleg n, da/J jeder 
Knoten auf eine Nachricht LEITWEG FESTLEGEN durch Aufzeichnen eines Eintrags in s in Leitweg- 
tabelle mit d m Identifizier n d s Leitweges und der Verbindungsstrecken und/oder Knoten darin, die 
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unmrttelbar zu dem betreffenden Knoten benachbart sind, antwortet, 

wobei das Verfahren dadurch gekennzeichnet ist, da/3 es weiter die Schritte umfaflt, dafl: 

jeder Knoten jeden Fehler ines unmrttelbar benachbarten Knotens oder einer Verbindungsstrecke in 

dem Leitweg feststellt, entweder beim Versuch, den Leitweg festzulegen, oder nachdem der Leitweg 

festgelegt wurde, und als Antwort darauf (i) den Status des Leitweges ats funktionsunfahig in d m 

betreffenden Eintrag in der Leitwegtabelle des Knotens aufzeichnet, wobei der Eintrag im wesentlichen 

unversehrt bieibt, und (ii) eine Nachricht LEITWEGFEHLER, die den fehlerhaften Knoten oder die 

fehlerhafte Verbindungsstrecke identifiziert, langs des Leitweges in der zum fehlerhaften Knoten oder 

zur fehlerhaften Verbindungsstrecke entgegengesetzten Richtung ubertragt, 

wobei jeder Knoten auf eine Nachricht LEITWEGFEHLER durch Absenden der Nachricht LEITWEG- 
FEHLER langs des Leitweges in der entgegengesetzten Richtung und ferner durch (ii) Aufzeichnen des 
Status des Leitweges als funktionsunfahig in den entsprechenden Eintrag in der Leitwegtabelle des 
Knotens antwortet. wobei der Eintrag im wesentlichen unversehrt bieibt und der Quellenknoten und/oder 
der Zielknoten zusatzlich die Nachricht LEITWEGFEHLER an die Topologie-Datenbank abschickt, urn 
den aufgezeichneten Zustand der Netzwerkknoten und Verbindungsstrecken auf den neuesten Stand zt 
bringen. 

Revendicatlons 

1. Un reseau de transmission des messages de donnees num^riques comprenant des noeuds (12, 14, 16, 
18. 20) connects par des liaisons (32. 34. 36, 40, 44), et dans lequel un message circule entre un 
noeud source et un noeud destination, suivant un itineraire comportant une suite de noeuds et de 
liaisons, ledit reseau incorporant des moyens de maintenance d'une base de donnees topologique 
(112), enregistrant les itinSraires de communication potentiellement disponibles au travers du reseau, 
ainsi que I'etat des noeuds et liaisons du reseau ; 

chaque noeud permettant la gestion d'une table de routage et : 

pour obtenir, lorsque ledit noeud agit comme un noeud source, un itineraire en provenance de la base 
de donnees topologique, et transmettre un message ROUTE SET-UP (parametrage d'itineraire) sur 
ledit itineraire de fagon a etablir ledit itineraire ; 

et reagir au message ROUTE SET-UP, par I'enregistrement d'une entree dans sa table de routage, 
ladite entree comportant I'identite de I'itineraire et les liaisons et/ou noeuds dudit itineraire, qui sont 
imm§diatement adjacents a ce noeud particulier ; 
ledit reseau etant caracterise en ce que chaque noeud permet, en outre : 

la detection de toute panne d'une liaison ou d'un noeud imm6diatement adjacent, dans I'itineraire, soit 
pendant la tentative de definition de I'itineraire, soit une fois quo I'itineraire a ete 6tabli et, en reaction a 
ladite panne (i) d'une part, I'enregistrement de I'etat de I'itineraire en tant qu'inoperant, dans I'entr^e 
correspondante de la table de routage du noeud (ladite entree demeurant substantiellement intacte), et, 
d'autre part (ii), la transmission d'un message ROUTE FAILURE (panne d'itineraire) identifiant la liaison 
ou le noeud detectueux, sur I'itineraire, ladite transmission s'eflectuant dans le sens oppose a la liaison 
ou au noeud defectueux ; 

la reaction a un message ROUTE FAILURE (i) par remission dudit message ROUTE FAILURE le long 
dudit itineraire, dans ledit sens oppose et (ii) par I'enregistrement de I'etat de I'itineraire en tant qu 
inoperant, dans I'entr^e correspondante de la table de routage du noeud (ladite entree demeurant 
essentiellement intacte) ; et 

la transmission complementaire, lorsque ledit noeud agit comme noeud source ou destination, dudit 
message ROUTE FAILURE a la base de donnees topologique, afin de mettre a jour retat enregistri 
des noeuds et liaisons du reseau. 

2. Un reseau, conform^ment a la revendication 1, ou chaque noeud permet. lors de la detection du retour 
a retat de disponibilite d'une liaison ou d'un noeud imm^diatement adjacent, la generation d'un 
message ROUTE ELEMENT OPERATIVE (element d'itineraire operationnel), indicant retat operation- 
nel. et gere de la m§me manure qu'un m ssage ROUTE FAILURE. 

3. Un reseau, conformement a la r v ndication 2, ou il existe trois types disponibles d'etat pour chaque 
noeud ou liaison du reseau, dans la base d donnees topologique, a savoir les etats OPERATIVE 
(operationnel), INOPERATIVE (inoperant) et UNKNOWN/(ASSUMED OPERATIVE) (inconnu/(pr6sume 
operationnel)), retat par d6faut 6tant retat UNKNOWN, et dont retat est bascule sur I'autre etat 
eventuel approprie, n reponse aux messages ROUTE FAILURE et ROUTE ELEMENT OPERATIVE. 
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Un reseau, conform^ment & toutes les revendications prgc^dentes, ou la base de donne s topologique 
sauvegarde les informations concernant les caracteristiques des noeuds et liaisons du reseau, et ou un 
noeud source envoie un message ROUTE REQUEST (demands d'itinSraire) sp^cifiant I'identite d'une 
source. I'identite du noeud destination et les caracteristiques de I'itineraire souhaite, & destination de la 
base de donates topologique qui, en rgponse k un tel m ssage, determine I'itineraire operationnel le 
mieux adapts et g^nere un message ROUTE-SETUP (parametrage d'itin^raire) correspondant, d^flnis- 
sant I'identite de I'itineraire seiectionne et les elements de I'itineraire dans I'ordre. 

Une methode de gestion d'un reseau de transmission des messages de donnees num^riques 
comprenant des noeuds (12, 14, 16, 18, 20) connectes par des liaisons (32. 34, 36. 40, 44), ou un 
message circule entre un noeud source et un noeud destination, suivant un itineraire comprenant une 
s^rie de noeuds et de liaisons de connexion (edit reseau incorporant des moyens de maintenance 
d'une base de donnees topologique (112), enregistrant les itin£raires de communication potentiellement 
disponibles au travers du reseau, ainsi que retat des noeuds et liaisons du reseau, chaque noeud 
permettant la gestion d'une table de routage ; 
ladite methode integrant diverses Stapes : 

un noeud source obtenant un itineraire d£livre par la base de donnees topologique et transmettant un 

message ROUTE SET-UP par ledit itineraire, de mani&re a ainsi etablir ledit itineraire ; 

chaque noeud r^agissant & un message ROUTE SET-UP par I'enregistrement d'une entree dans sa 

table de routage, ledit enregistrement comportant I'identite de I'itineraire et des liaisons et/ou noeuds 

concernes, qui sont imm^diatement adjacents & ce noeud particulier ; 

ladite methode £tant caracterisee en ce qu'elle comprend, en outre, les Stapes suivantes : 

chaque noeud ddtectant une quelconque panne d'une liaison ou d'un noeud imnrtediatement adjacent 

dans I'itineraire soit pendant la tentative de definition de I'itineraire, soit une fois que I'itineraire a ete 

etabli et, en reaction & ladite panne, d'une part (i) 3 I'enregistrement de retat de I'itineraire en tant 

qu'inoperant, dans f'entree correspondante de la table de routage du noeud (ladite entree demeurant 

substantiellement intacte), et, d'autre part (ii), & la transmission d'un message ROUTE FAILURE (panne 

d'itineraire) identifiant la liaison ou le noeud defectueux, sur I'itineraire, ladite transmission s'effectuant 

dans le sens oppose h la liaison ou au noeud defectueux ; 

chaque noeud repondant & un message ROUTE FAILURE (i) par remission dudit message ROUTE 
FAILURE le long dudit itineraire, dans ledit sens oppose et, (ii) par I'enregistrement de retat de 
I'itineraire en tant qu'inoperant, dans ('entree correspondante de la table de routage du noeud (ladite 
entree demeurant essentiellement intacte) ; et 

le noeud source et/ou le noeud destination transmettant, en outre, ledit message ROUTE FAILURE & la 
base de donnees topologique afin de mettre & jour retat enregistr£ des noeuds et liaisons du reseau. 
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